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Distributed Nonlinear MFC of Multi-Agent 
Systems with Data Compression and Random 
Delays - Extended Version 

Sami El-Ferik, Bilal A. Siddiqui and Frank F. Fewis 


Abstract 

This is an extended version of a technical note accepted for publication in IEEE Transactions on Au¬ 
tomatic Control. The note proposes an Input to State practically Stable (ISpS) formulation of distributed 
nonlinear model predictive controller (NMPC) for formation control of constrained autonomous vehicles 
in presence of communication bandwidth limitation and transmission delays. Planned trajectories are 
compressed using neural networks resulting in considerable reduction of data packet size, while being 
robust to propagation delays and uncertainty in neighbors’ trajectories. Collision avoidance is achieved 
by means of spatially filtered potential field. Analytical results proving ISpS and generalized small 
gain conditions are presented for both strongly- and weakly-connected networks, and illustrated by 
simulations. 


I. Introduction 

Cooperation between autonomous vehieles has shown promising advantages in terms of ro¬ 
bustness, adaptivity, reeonfigurability, and sealability. A prevalent teehnique for formation eontrol 
is MFC for its inherent ability to handle eonstraints and uneertainty. Dunbar et al [HI eonsidered 
distributed NMFC for synchronization of agents by broadcasting state error trajectories to the 
immediate neighbors. A generalized framework for distributed NMFC for cooperative control is 
proposed in [[21, where asymptotic stability is ensured by terminal constraint set. A framework 
for quasi-parallel NMFC without restriction of terminal set, extended to the multi-agent case 
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recently is shown to be asymptotically stable [|3||. Distributed NMPC was considered for a 
group of strongly connected agents receiving delayed input from their neighbors in [|4l-ll5l. 
The delayed information is projected in the prediction horizon using either a time-based forward 
forgetting-factor or by linear recurrence, respectively. Collision avoidance (CA) within MPC 
framework is well studied for linear systems [[6l|, but similar work in nonlinear MPC setting 
is still rare. CA among multiple vehicles is achieved by adding a repelling potential field to 
local NMPC cost function and transmitting the entire planned trajectory Q- Priority strategy for 
CA in NMPC framework, using neighbors’ randomly delayed information has been proposed 
in 101. Hierarchical multi-level control is considered in |[8l by combining potential field with 
linear MPC, such that only the first step of the trajectory is optimized and linear recursion 
is used to predict the trajectory over the remaining horizon. Stability proofs are unavailable 
in most of these CA works. In this note, we address fleet control with collision avoidance of 
constrained autonomous vehicles subject to limited network throughput and propagation delays 
by employing distributed NMPC control. Each agent performs local optimization based on an 
estimate of planned trajectories received from neighboring agents. Since network throughput 
is assumed limited, exchanged trajectories are compressed using neural networks (NN) as a 
universal approximator. This property is crucial in our stability analysis, since the impact of 
estimation error on system dynamics is considered as a bounded non-vanishing (persistent) 
disturbance. Correction for propagation delays is achieved by time-stamping each communication 
packet dUl. Collision avoidance is achieved by formulating a new spatially-filtered repelling 
potential field which is activated in a “gain-scheduling” type of approach to avoid transforming 
the problem into mixed-integer nonlinear programming. We prove this distributed control strategy 
to be ISpS for heterogeneous agents connected in strongly- or weakly-connected network, robust 
to uncertainty in neighbors’ planned trajectories. This algorithm is an improvement over ||4l 
and contributes to the literature with the following original results: (a) Only an approximation 
of planned trajectories is transmitted; (b) NN-based data compression algorithm is used in 
compressing the planned trajectories; (c) collision avoidance by using a spatially filter potential 
function with rigorous stability proofs; (d) new ISpS and generalized small gain conditions are 
derived to ensure stability of proposed algorithm; (e) stability results are extended even to weakly 
connected networks. 
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II. Preliminaries 

Let L 2 Euclidean norm be denoted by | ■ | and let | • |oo be the L^o norm. The identity 
function is denoted by X ; M —)■ M, functional composition of two functions 71 and 72 by 
7 i o 72 and function inverse of function a by a For a set ^4 C R", the point to set distance 
from C G R to A is denoted hy d((, A) = inf {| 7 — ^ 7 G A}. The difference between two 

sets A, i? C R** is denoted by A\B = {x : x ^ A,x ^ B}. An indicator function of vector x 
defined as lx>o = {lif a: >- 0, 0 otherwise}, where >- is element-wise inequality. We also use 
class /C,/Coo and ICC comparison functions ifTOl . Consider the discrete-time nonlinear system 
Xt+i = f{xt,Wt) with /(0,0) = 0, where Xt G R” and wt G R’’ are state and external input 
respectively. If Xt G S, Vf > to whenever Xt^ G S and bounded input Wt G W, then S is called a 
Robust Positively Invariant (RPI) set. Moreover, if S is compact, RPI and contains the origin as 
an interior point, the system Xt+i = f{xt,Wt) is said to be regionally Input-to-State practically 
Stable (ISpS) in S for xq G S and tc G IE, if there exists /C£-function fd, /C-function 7 and 
constant c > 0 such that 

\xt\ <{\xo\ A) + 7 {\wU + c (1) 

If c = 0 , then the system is said to be regionally Input-to-State Stable (ISS) in S [ITO . Function 
V : R" X R" —)■ R>o is an ISpS Fyapunov function in S, if for suitable functions 01,2,3, o's ^ ^00, 
(Ti ,2 G JC and constants c, c > 0, there exists a compact and RPI set S and another set C S 
with origin as an interior-point (f2 is also RPI), such that the following conditions hold, 

V{xt,wt) > ai{\xt\), WxtEE ( 2 ) 

V {f {xt,wt) ,wt+i)-V {xt,wt) < 

-02 (kll) -f CTi (|Wi|) -f 0-2 (|wt+l|) + c, Wxt G S 

V {xt,Wt) < aoilxtl) + asdwtl)+ c, Vx* G (4) 

The relation between ISpS Fyapunov functions and ISpS is shown in Theorem [T] ISS implies 
ISpS, but converse is not true, since an ISS system with 0—input, i.e. tCfc = 0,V/c > 0 implies 
asymptotic stability to the origin, while for an ISpS system, 0—input implies asymptotic stability 
to a compact set (ball of radius c) containing the origin. In this paper, the stability analysis will 
demonstrate that according to the proposed control approach, closed-loop dynamics is ISpS, 
not ISS, due to uncertainty resulting from data compression. Thus, in this study, c in equation 
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([U) is not zero but function of bounded error in NN estimation. Information exchange among 
networked vehicles is conveniently modeled by general mixed graphs (directed and undirected 
edges). An information graph is a set of nodes A* and edges connecting node pairs E{A^,A^). 
Define connectivity matrix as F = [ 7 *^], where 7 ^^ > 0 if (A®, A-’) G E and 0 otherwise (by 
convention = 0). Neighborhood of a node A® is G® := {A^ : > 0} U {A^ : ^ji > 0}. A 

network is said to be strongly connected if there is an undirected path from any node to any 
other node in the network. In this case, connectivity gain matrix F is irreducible. A network is 
said to be weakly connected if there are at least two nodes for which a directed path connecting 
them does not exist. For weakly connected networks, connectivity gain matrix F can be reduced 
to upper block triangular form ffTTI . Next, we will formulate the distributed multi-agent problem. 


A. Distributed Multi-Agent NMPC with Collision Avoidance 

Consider a set of N agents A® each having nonlinear discrete-time dynamics: 

x\^^ = r{x\,u\), Vf>0, i = 


(5) 


Local states x\ and control inputs u\ belong to constrained sets x) G X® C M®®* , G f/® C M®®®* . 
Agents are decoupled from each other in open loop. On the other hand, closed-loop control 
takes into account the neighbors’ states and therefore couples the dynamics. Let w\ be the 
approximation of trajectories w\ = {x^}, Vj G G® of neighbors of A®, such that wl G IF® C 
For each agent A®, the general finite-horizon cost function is defined as: 


t+N^-l 


4 = E [h" {xh u\) + g® {xi wj)] + Efixi^^i) 


( 6 ) 


i=t 


where X® and X® are prediction and control horizons respectively. Distributed cost dH) con¬ 
sists of local transition cost h\, local terminal cost and interaction cost q\, see IIH for 
details. We define an agent A® to be on collision course with at least one other agent if 


E 1 

jeGi 


(RLin-^E>oyt<k<it+Ni) 


> 0 , where i?min is the safety zone of an agent and (f^ is the 


Euclidean distance between agent A® and AA Repelling potential can be formulated as: 


jeG* 


X R* 1 

t+N}, 

E m)4 

k=t 


( 7 ) 
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where 0 < Amin < H^ij) < Amax are positive weights of a filter and are strictly decreasing in 

t+N}, 

their argument, such that A = ^ )• If at any instant t < k < {t + N^) in the prediction 

k=t 

horizon, an agent A* has a feasible trajectory which falls within i?min ‘^f agent A^, the repelling 
potential ([7]) becomes non-zero. To cater for collision course, cost ® is modified as 

Ji = jiii + ^i) (8) 

Strength of potential field ([7]) is inversely proportional to the weighted average distance between 
the two agents ^ The weights A, strictly decreasing with ensure that 

k=t 

the smallest separation between two agents gets the highest weight. On the other hand, taking a 
simple average (i.e. A = 1) or a time-based forgetting factor (A is strictly decreasing with k, the 
time index), results in poor performance in collision avoidance, as trajectories which enter very 
late in zone i?min (i-e. > 0, A; —)■ t + N^) have a small repelling potential (|7]), and hence 

not prevented from very early on. Such strategy results in agents getting very close before they 
start repelling each other to avoid collision. However, with cost ([8]), trajectories are immediately 
penalized upon falling within zone 7?min obviously avoided in the NMPC optimization. 

The indicator function in (|7]) acts as a “gain-scheduled” binary (0-1) variable depending on 
whether a feasible trajectory falls within We define successful collision avoidance to 

occur if weighted average distance between the agents on collision course increases i.e. 

t+N\, t+N\,+l 

< ^ AKM' (9) 

k=t k=t+l 

Control sequence consists of and The latter part is generated 

by local auxiliary control law u\ = k'j{xl) for t > N^, while the former is the distributed 
optimal control m* which is the solution of the Problem [TJ Suboptimal m* satisfying 

all constraints is called feasible control. 

Problem 1. At every instant f > 0 for each agent, given horizons and N^, and auxiliary 
control kffind the optimal control sequence which minimizes distributed finite horizon 

cost dH) (or ([8]) /or collision avoidance), satisfies state and input constraints and system dynamics 
©, such that the terminal state is constrained to a terminal set, i. e. G X^. In the receding 

horizon strategy, only the first element of is implemented at each instant, such that the 
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closed loop dynamics becomes 


( 10 ) 


B. Data Compression 

For cooperation, agents transmit their planned state trajeetories, G but reeep- 

tion oeeurs after some delay To reduee paeket size, trajeetory eontaining n* x floating 
points is eompressed by approximating it with neural network AA* of g* weights and biases, 
with eompression faetor of 1 — (g* + overhead size)/(n* x N^). Overhead size aeeounts for 
agent identity i, time-stamp (T^*) and sampling time T* ete. The leader also eommunieates 
formation geometry and way-points to followers. It is assumed that there exists a meehanism for 
synehronizing eloeks, whieh allows delay Aji to be estimated. NN at A* is trained using state 
trajeetory as output and diserete instants as input. Using sampling rate and predietion 
horizon at , re-sampled trajeetory w{ G C is generated using reeeived 

neural network J\f\ If horizon is suffieiently long, states ean be extrapolated with bounded 
error. If paeket is delayed by more than a threshold A, the paeket is deemed to be lost. Any 
smooth funetion w{t) ean be approximated arbitrarily elosely on a eompaet set using a NN with 
appropriate weights and aetivation funetions [fT^ . Let w{t) be a set of smooth funetions, then we 
ean show w{t) = w{t) -f A where w{t) is approximation of w{t) by NN, and r = col{t, t.. .t) 
is the staek of t veetor n* times and ^ is NN approximation error whieh is inversely proportional 
to hidden-layer size Hi. Error Q in predietion also depends on the delay in information 
reeeived from due to extrapolation of trajeetory tail ). If the error (or delay) is 

greater than an upper bound, i.e. Q > I a feasible eontrol for avoiding eollision may not exist. 
This means that agents will get too elose due to error sueh that there is not enough time to 
maneuver for avoiding eollision. Consequently, we assume an upper bound on the permissible 
delay A''^ < A, whieh is the worst ease seenario of two agents on a direet eollision eourse at 
maximum permissible speed and with minimum separation between them, i.e. A = i^min/'^max- 
With this eonservative (ean be relaxed) bound on AW there is always enough time to exeeute 
eollision avoidanee maneuvers. 
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Algorithm 1 DNMPC Algorithm with Collision Avoidance 


1: 

Given A\A^ ^ x\,,d^\d^\g^ 

> i = 1 A Leader, / = 0 

2: 

Solve Problem offline for and 


3: 

procedure Collision Free Distributed NMPC 


4: 

Design Spatially filter potential (fT3l) 


5: 

Solve Problem [Hat A* for 


6: 

Train NN Train Neural network for 


7: 

Implement first element/block of 


8: 

Transmit/Receive data packets 


9: 

Estimate time delay 


10: 

Reconstruct with received NN 



Increment time by one sample 

= Ti 

11: 

end procedure 

> End CF-DNMPC Alg. 


III. Stability Analysis 

We first state an important new result in regional input-to-state praetieal stability. This general 
result will form the eomerstone of later development. 

Theorem 1. If system Xt+i = f{xt, Wt) admits an ISpS-Lyapunov function in S, then it is regional 

^ 3 

ISpS and satisfies condition ([7]), with /3{r, s) — Q!i“^(3/3(3a3 (r), s)), 7(5) = Q!i“^( 3(7(3 ^ (Ti(s)) + 

i=l 

/9(3(T3 (s) , 0))) and c = ai“^(3(/9(3(c + d), 0) + ai“^7(yu(3c)) + q;i“^7(3c)), where /r, 7 G /Coo 
while G ICC (d is defined in proof). 

Proof: for all Wt^t+i G W. Sinee Cl is RPI, therefore for xi G E\Cl and X 2 G Cl, there exists 

d > 0 such that V{xi,wi) < V{x 2 ,W 2 ) + d for wi ^2 G W. Letting 0 : 3 ( 5 ) = 03 ( 5 ) + 03 ( 5 ) + s, 

02(5) = min(o2(s/3), (73(5/3),/i(s/ 3 )), 04(5) = 02(5) 073^(5), w = maxdtCf |oo, ki+iU), 

3 

u{w, c^, c) = ^ CTiiw) + p,{c) + c and seleeting p G /Coo sueh that {X — p) G /Coo, we ean define 

i=l 

a eompaet set D C C S eontaining the origin: D = {a;| d{x,dCl) > di, V{xt,wf) < 7 (l;)}, 
where 7 = O4 ^ o p~^. With these definitions and using steps similar to equations (14)-(17) in 
proof of Theorem 4.1 of [|4l|, we can show that D is RPI. Moreover, D ean also be shown to be 
asymptotieally attraetive for state starting in E\D using arguments similar to equations (18)-(23) 
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of JH. Hence, a state Xt starting in S will enter Vl\D in finite time, and from there it will enter D 
in finite time as well, where it shall remain as D is RPI. Using a standard comparison lemma [[T3ll . 
3/3(r, s) G ICC such that V (xt,Wt) < max0(V (xo,Wo) , f), 7 (a;(|wt|oo, c, c)), Vxt e E,Wt E W. 
Using a property for /C functions: a(ri + r 2 + rs) < a(3 max(ri, r 2 , ra)) < a(3ri) + a(3r2) + 
a;(3r3), we can show that system Xt+i = f{xt,Wt) is regional ISpS in S, Vx* E E,Wt E W. ■ 
We will now particularize this result for Algorithm [B Stability is analyzed in two stages. 
First, individual agents are shown to be ISpS and robust to communication delays and trajectory 
approximation error in a subset of X*, followed by generalized small gain condition for team 
stability. 


A. Stability of Individual Agents without Collision Avoidance 

Asymptotic stability (ISS) for MFC schemes can be shown in case of additive and vanishing 
disturbance, but only ultimate boundedness (or ISpS) can be guaranteed in case of non-vanishing 
(not decaying with state) uncertainties lfT4ll . In the proposed approach, the uncertainty in tra¬ 
jectory approximation C, is non-vanishing and one can only guarantee ISpS. We consider first 
the stability of individual agent A* with respect to the information received from other agents, 
by exploiting Theorem [TJ At this stage the interconnections are ignored, and information from 
neighbors is considered as external input. We assume at this stage that agents generate conflict 
free trajectories. 


Theorem 2. Let terminal set C X* be RPI andlet k^j:{xl), f^{xl,kj{xl)),wl_^_i,hl'{xl,ul),q\xl, 
h0xl,ul) be locally Lipschitz with respect to xfu\ and w\ in X* x f/* x IF*, with the fol¬ 
lowing Lipschitz constants Lp and Moreover, there exist non¬ 

linear bounds aij,a 2 j,P‘ E /Coo such thatif{\xl\) < h^{x\,u\) and aij{\x\\) < h0x\) < 
a2j{\x\\),'ix\ E X\ Now, if the neural network trajectory approximation error is bounded 
\wt\ < \wt \ + the following holds for x\ E X'^^ and w\ E IF* 


h){f\x\ k}{x0) - /i}(F) < -/i*(a;*, A:}(F)) - f{x\ fi)*) + 


( 11 ) 


for some E K,, then agent A* under NMPC optimal m*’* and terminal k^jr{x'‘) control laws 
admits ISpS Lyapunov function V^xfwful) = Jl{x0and is therefore ISpS with 
robust output feasible set X^p^ C X*, which is the set of initial states for which the Problem 
[7] is feasible. 


w 
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Proof: We need to prove that V(xl, u^, wl) = , wl) is an ISpS Lyapunov fune- 

tion. The lower bound on V{xf wl) is obviously given by r!{\xi\) = ai(ktl) < Vxj e 

. . . . . . . . 'JP 

X'^,wl e W\ Loeal eontrol = [/cj(a;J),..., is feasible but subopti- 

mal Vx* G Xj, i.e. V{x\,wl) < Jl{xfwl,u\^^j^i). Using assumptions in Theorem [2l we 

. . . fji —. . =. 

get V{xfwl) < a\{\xl\) + (t\{\wI\) + c*, where ^ 3 ( 5 ) = ^s) + If, ^^(s) = Vs and 

c* = The eonstants are V = - 1)“^ and V = 


(Li 

^ fi 


\-^gw 


■ ■ T 

l){Ll^-l)-\ Clearly, ^/(^t+ivp] feasible eontrol 


t+N; 


forx* e XVc whieh gives ^ {h{xlul) + q{xi,wl)}+h){f{xl^^i,k}{xl^^i 

i=t+i ^ ^ 

where, wi is NN approximation of wl_^_^ and wi is approximation of wf henee wi f wi. Caneeling 
eommon terms, we get V{xl_^_^, wl_^_i) — V{xf wl) < —+(T];(|tcJ|)+ (T 2 (|tcJ+i|)+<?, where 
cTi(s) = ct 2 (s) + f^is), a 2 {s) = bs,c = 1 x 2(0 and b = - 1)(L^^ - 1)"^ Henee, 

from Theorem [H the system ([5]) under NMPC is ISpS. ■ 

A method for terminal eontrol law design (by solving (fTT]) l is given: Let h) = x) Q^x] + 
uf R-u), ql < xf' S'^xl + and = x^'^Q^x) , where Q\ R\ and S'* are positive 

definite matriees for i = 1,... M agents. Let Rji^x]) = Rx] exist, sueh that A* = A* + 
is stable, where AJ, and S* are the Jaeobians of system ©. The terminal set is defined as 
Xj = < a for some a G M>o whieh satisfies eonstraints x* G X* and m* = X*a;* G U\ 

Let Q\ be the solution of the eonvex problem. 


Problem 2. 


min [-log(det(ag}))] 

Qf,Kf 


( 12 ) 


subject to the Lyapunov inequality A*^Q^A* — gj + g* + X*^i?*X* + (X — 1)S* A 0, and Q/ > 0 


B. Stability of Individual Agents with Collision Avoidance 

Results of the previous seetion will now be extended to prove stability of the agents under 
the eollision avoidanee seheme deseribed in Seetion HLAI Let V{xl,wl) = Jl{xl’*,wl) be the 
local ISpS Lyapunov function for A* without collision avoidance. Let be the optimal 

solution of the cost ® and be the optimal solution of the modified cost ([8]). We will 

prove that V{xl,wl) = Jl{xj*,wl) is an ISpS Lyapunov function. It is obvious that dij{k) 7 ^ 0 
for at least one instant t < k < t + Nf since otherwise would mean that the current position 
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as well planned optimal trajeetories of two agents eoineide exaetly, whieh is impossible. We 
assume that K*|f*’*| < for some eonstants > 0, sinee both x*’* and x*’* 

are finite. This leads to bounds on potential funetion, i.e. ^ for some eonstants 

> 0. 


Theorem 3. For an agent on collision course, the optimal trajectory for modified cost ([8]) 

not only guarantees collision avoidance with other agents in the sense of dH), but also maintains 
input-to-state practical stability, if its repulsive spatial filter weights are chosen at each 

instant such that 


Amax.t ^ ^ ^ 

Amin,! ~ + L\x) + Lhf 


(13) 


Proof: The proof eonsists of two parts. We first show that negative gradient of modified eost 
([8]) lies in the direetion of expanding weighted average distanee (fj between agents on eollision 
eourse. Henee, the optimal trajeetory reaehes the terminal set by avoiding eollision in 

the sense of dH). Next, we will show that the optimal trajeetory in that direetion is also ISpS 
stable. From dH]), we ean see that = ^-(1 + Sinee d^\/ddf = —^\/df < 0 

. Sinee Jl, djj > 0, 


ddp' 


and Jj, > 0, in order to have dJl/ddf < 0, we have 


n. Ji ^ jii. 


Ji 




this eondition ean be satisfied if max 


dJl 


ddtj 


differentiation and using triangle inequality, 


< 


dJi 


ma,x{df ) 


. For RHS, note that by ehain rule of 




t+m 


< E 


k=t 


dJi 


9^1 


dxl 




ddl^ 




. With slight abuse of 


notation we ean write = \x\ — w]j\. For given neighbor trajeetory = x;^, Vj G G*, we have 
dd^i/dx\ = {x\ — w]j)/d!'i sueh that \dji/dx\\ = 1. Similarly, dd\^/dd^l = A*^, whieh results in 


dJi 




t+N; 


k=t 


< E ^ S <A^ E 0 • Now, from dH), we get 


t+m 


k=t 


aji 


max 




< 


iN;-l){Li+Lfi+Lif 


(14) 


Now, maximum df ean oeeur when the minimum distanee between agents on eollision eourse is 


t+m 


R\n\n and then move away from eaeh other at Umax, he- max((ij'^) = ^ ^k{.R\am + 2(A; — t)xmax) < 

k=t 

Amax,!(^p-Rmin + ^pi^p ~ l)'nmax)- Also, as uoted iu Theorem [H min(J^*) < Vj < r*(|xj|). This 
ean be eombined with (fT4l) to result in the eondition speeified in (fT3l) . Henee, the minimum of 
modified eost lies in the direetion of eollision avoidanee in the sense of dH). Sinee any feasible 
trajeetory for eost dll) is also feasible for modified eost dSl) and the reaehable set is eompaet, an 
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optimum almost always exists, unless there is not enough time to maneuver (to eater for whieh 
we have plaeed a eonservative bound on <A). 

For the next part of this proof, note that J{xf, wl) < wl) and J{xl’*, wl) < J{xl’*, wl), 

sinee xl’*^i is feasible but suboptimal eontrol for minimization of ® and x]’* is suboptimal 


for dH]). For eoneiseness, we will ignore the differenee between V and J in this seetion and also 
drop the -k symbol. From Theorem [2l we have < V{x\,wl), whieh gives a\{K^\xl\) < 

V{x\,wl) < V{xl,wl). Combining this with dS]) and defining d\{s) = + G /Coo, we 

get < V{xl,wl). Let V{x\,w\) — V{xl,wl) < x* for some eonstant x* > 0. Defining 

03(5) = (1 + G /Coo, <^3('S) = (1 + $*)(T3(s) G /C and c* = (1 + + x*), we get 

V {xl,wl) < dsdiji) + &3 {\wl\) + c\ Using dSl), and defining d^is) = (1 + G /Coo, 

di,2{s) = (l + $dcri,2(s) G /C, c* = + + we get Ti^-^V -U {xi,wi) < 

-02 {\xl\) + (Ti (IwJl) + ^2 (|tf^?+i|) + where,TJ+;^ = From dU), > 1 if dSl) holds 

and we ean write V -U {xi,wi) < -d2 {\xi\) + &i {\wi\) + &2 (Iwj+il) +cC Henee, 

agent A* is ISpS aeeording to Theorem [T] and moves towards its goal in an optimal manner 
while avoiding eollision with other agents. ■ 


Corollary 1. If spatial filter for collision avoidance is shaped as a geometric progression = 
-^max.At dl'i > df_^-^ for / = 0,... Ap — 1, then the filter can be designed by specifying 

b > 1, Xlaaxt calculating rt = (fdt) from dTSl) . 


C. Stability of Team of Agents under NMPC 

We will establish a generalized small gain eondition to prove stability of the intereonneeted 
system, for both strongly- and weakly-eonneeted network topologies. The result is general, not 
limited by the number of subsystems and the way in whieh subsystem gains are distributed is 
arbitrary. 

Theorem 4. For a team of agents A* dT^ . each with local ISpS Lyapunov function V{xl,wl), 
there exists a G /Coo such that V{x\j^i,wlj^f) — V{xf wl) < &’{\x\\). Let the ISpS Lyapunov gain 
from A* to G G® be denoted by the function ■ ^>0 ^ ^>0 given by 

dij{s) = o o(t\o (a{)"^(s), (15) 

then the team of agents is ISpS stable if the network is at least weakly connected, as long as 
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the following small gain condition is satisfied 


V{xi,wi)> max 

jeG\j^i 


(16) 


Proof: Consider G JCoc.CetV{xi^^,wi^f-V{xi,wi) < -ai{\xi\)+a\{\wi\)+ai{\wi^f) + 
c* < p* o a^dxJl) for x\ e and for e /Coo constructed such that a{{\wl\) + 

'^ 2 (l'^t+il) + c* < (X + p *)°«2 Then, in view of Q and letting d* = (X + p*) o we 
get V{x\,wl) > a\ o ° Now, since w\ = col{x^ .), then \w\\ > max|a;d > 

t^t-\-Np j 

\x{\, Vj G Gh Hence, V{xfwl) > max{a\ o °'^i(kil))- But, V(xi,w{) > a{{\x{\) 

j 

^ {&)~^{V{x{,w{)) > \x{\, and hence V{xfwl) > max(Q;^ o o cr|^ o (a{)~^{V{x{,w{)). 

j 

If gain fij is defined as in (fT5l) . then (fT^ is obtained. From recent results in ifTTI . it can be 
shown that this is equivalent to having an ISpS Lyapunov function for the network. ■ 

Remark 1 


One way to design 6d is by choosing p*(s) = Ids, 'ikd > 0, since it was shown that — < 

0. This choice results in stable network, provided that individual agents are locally ISpS. We 
take the case of agents not on collision course first. 

Agents not on collision course: Continuing from proof of Theorem 2, and letting Anmax and 
Anmin be the maximum and minimum eigenvalues of a p.d. matrix If, respectively. Then, 

Cl (’■) = cri (’■) + ■4’’ ('■) = ^ ,T -;-- 1 ) ^SL,y^ ^ 1 . 




For Lgruj = 1, the results need trivial modifications, by replacing 


l=N^-2 


with ^ LiJ = N;-1. Similarly, 


1=0 


a{ ^(r) = 


min QJ 


' (r) = 0^2 ' o (/ + p*) ^ (r) 


iV‘-l 


i) dy -1) 


-1 


and 


^qw ^Smax\'^ 


I I 
max \ 


We mentioned that one choice of p* could be p* (r) = /cV for all /c* > 0. Therefore, 

1 


cd ^ (r) = af, 


fc* — 1 
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It is also worth noting that we showed in the proof of Theorem that a 2 {r) = 02 (r). Sinee 

jij{r) = o a* ^ o a\o a{ (r), we ean obtain 




fc* + 1 

Henee, (fT^ ean be written as 


A 


+ 


minQi /c T 1 


(M - 1) Xsi 


minQ3 


Ho {x\x^)) = 


fc* + 1 


- 1 ) 


Ai 






minQ3 

+ 


\/V {x\ ) 


1 , , / /A S'' 

(M — 1) ' 


A;* + 1 


A 


^minQ^ / 


1 / {x\ ff) 


Therefore, by ehoosing a suitable value of and > 0, the small gain eondition 

(fT^ ean be satisfied. 

Agents on collision course: For agents on eollision eourse, similar results ean be reprodueed as 
all funetions have eorresponding eounterparts in eollision avoidanee ease, see proof of Theorem 
m Therefore we ean write (fTSl) as 7 ij(r) = o o a'^ o (a^)~^{r). Thus, we get 


Hj = 7t 


(1 + 0 *) 


(fc* + l) iH 


{n; - 1 ) 


At 




Smax 


:(r )2 + 


(M - 1) A^i 


XminQi iH {l+f) XminQj 


Henee, even with eollision avoidanee, it possible to find fc® > 0 whieh satisfies the small 
gain eondition (see ITVl) . As far as the small gain eondition for weakly eonneeted networks is 
eoneemed, we show in Remark 2 that the small gain eondition is equivalent to that for strongly 
eonneeted networks. It should be noted that there is no need to find the exaet numerieal values 
for eonstruetion of eontroller. As long as there exists some fc* > 0, we ean be assured of ISpS 
stability of the team. See Seetion UVl 

1) Strongly Connected Network: We will now partieularize the result of Theorem |4] to the 
ease of strongly eonneeted network. 


Lemma 1. A team of N agents connected with a strongly connected network is ISpS stable if 
each agent A® has an ISpS Lyapunov function V^xfwf), edge gain fij is defined as in (fT5l) and 
the following small gain condition is achieved: 

> max{fij{V{xlwl))), Vj i, j = 1,..., N - 1 

3 


( 17 ) 
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Proof: If fp is a monotone aggregation funetion (MAF) and F is its irredueible gain matrix, 
define the gain operator F^ : —)■ M”, 


F- = 


ri 


/^i(7i2(ri),...,7in(rn)) 


!-)■ 


Tn 


/^n(7?^,l(^l)’ * * * 5 l(^n—l)) 


(18) 


Aeeording to the reeent generalized small gain theorems of [fTH . if a strongly eonneeted network 
obeys the following small gain eondition (SGC): X > F^, then it is stable in the ISS sense 
(see Theorem 5.3 of IfTTI ). Now, /2 = max is a monotone aggregation funetion ( IfTSlI ). Let 
r = iy {x], wl),... ,V {x^, wf)), then the SGC is satisfied if: 

V{x\,w\) 


V{x^n^Wn) 

This ean be simply stated as: 


> 


max( 7 i 2 (L y, wf)), {x%, wJ))) 
max( 7 jv,i(C {x{,w\)),..., fN,N-i{V{x%_^, w%_f))) 


Vixfwl) > m&xyj{V{xlwl))), yj = 1,...,N -1 

j 


2) Weakly Connected Network: We will now foeus on the ease of a network of agents, in 
whieh not all agents are eonneeted to every other agent. 


Lemma 2. A team of cooperating agents connected with a weakly connected network is ISpS 
stable if each agent A* has an ISpS Lyapunov function V{x\^w'f), edge gain y is defined as in 
dlS]) and the following small gain condition is achieved: 

yi.xfwl) > max(%(L(a;^,w^))), Vj e G* 

j 

Proof: The eonneetivity gain matrix for a weakly eonneeted network ean be brought in 
upper bloek triangular form by appropriate re-indexing of agents, sueh that eaeh upper bloek on 
the diagonal is either 0 or irredueible. Henee, we ean now rewrite the gain matrix as: 

0 7i2 7 i3 • • • 7i,m 

0 ■ • 723 • • • 72,M 


F = 


In-1,M 

0 ... 0 0 
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where M = maxM* is the size of neighborhood of the most conneeted agent. According to 

i 

Proposition 6.2 of ifTTI . the interconnected system is stable if each upper diagonal block satisfies 
the SGC: X > F^,. Now, the upper diagonal blocks are: 





0 

7l2 

7l3 

0 

7l2 

_ 





, Ts = 

0 

0 

723 

0 

0 





*- 



0 

0 

0 


0 7l2 713 
0 ■ • • 721 


71, d 

72, d 


rAr = r 


1d-l,d 

0 ... 00 


Then stability is assured if each of the above blocks obey the SGC iteratively, i.e. 

G > r^i (g) ^ V{xj,wj) > 0 

r2 >Tp2{r2) ^ V{xj,wl) > {x^ w^)), V{x^ wf) >0 

G > rp3(G) ^ V{xl, {xl,wl)) > max(7i2(V^(a;2,'«;2)) ,7i3(l/(a;3,w3))) 
Vixlwf) > ^23iV{xlwf),V{xlwf)) > 0 


(19) 


This iterative procedure reduces to (fT^ . Hence, the team is stable irrespective of the network 
topology as long as it is at least weakly connected, provided it obeys certain small gain conditions. 


IV. Simulation Results 

Consider a fleet of 5 autonomous vehicles moving in the horizontal plane, with the following 
continuous-time models (discretized at T=0.1s) having similar dynamics (for simplicity): = 

—^\x'^ + (m)j + u\) cos 0 *, + (m):j + u\) sin 6\ + (m):j -f u^) r„ where 

m ,J, ^ 1,2 and are parameters specified in dUl). Constraints on inputs and states are 0 < 
\url\ — 6 1^1 < Irad/s. Uniformly distributed communication delay is bounded by T < Ajj < 
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6 T. Distributed cost for each agent (leader A^)\ 


Ji= E 



where zl = zl — gl + and zl = zj — wj + a*-^. Goal gl is the way-point (WP) for leader 
and for followers it is the leader’s planned trajectory, i.e. g^ = 1. Alignment vectors 

define the formation geometry such that adjacent agents occupy positions 15 units apart in 
a 30 units equilateral triangle with same speed and direction. Optimization parameters for all 
agents are: Np=50, Nc=l5, Q=0.1 (iza( 7 (l, 1,10, 1, 10,1), i?=0.01 diag{l,l), S^^=0.25 Q and 
S'^■^=0.2 S'*-’, for i = 1... 5, j e For spatially filtered CA potential (fTSI) . parameters are 
-Rmin = 5m,Umax = 40m/s, = Ag^maxl^ol, = {N - 1)A^^max||, L]^f = AQ/,max|A*| and 

1 * = Ag^minl^feP, whcrc An is eigenvalue of If. Local control Sf* and terminal weight can be 
determined solving the LMI equation presented in Section ITTT-Al Simulations were run on 3.3 
GHz Intel (quad) Core 17-2500 using parallelized Matlab code, where 1 simulation second took 
94 CPU seconds (which can be reduced on dedicated hardware and optimized code). For NN 
we use a network with 6 inputs, Hl=6 hidden layer neurons and 6 outputs. Thus there are 84 
NN weights and biases as opposed to full trajectory of 300 floating-points (data compression of 
72%). We only show results of weakly connected network due to lack of space. and have 
only directed link from and A^, making the network topology weakly connected, see inset 
of FiglU Executing sharp turns, such as right angle turns when transitioning between WPs puts 
agents on the inside of the turn (A^, A^) at risk of collision. Also, A^’® receive WP information, 
with extra delay due to multiple hops, i.e. A 4 = A 5 = 2 A. However, collision is successfully 
avoided throughout the trajectory. Synchronization of states is achieved quickly, as shown in 
Fig. |2l The effect of delay is manifest in lag in synchronization, while temporary divergence is 
due to collision avoidance. It is evident that the proposed algorithm performs well despite large 
random delays. 

In the given example, cost function and corresponding gain is shown in Fig. [3] to illustrate 
verification of small gain condition (fT^ from Theorem |4] for fc* = 5 x 10^. ). The condition 
for only Agent 1 (connected to Agents 2 and 3 in the weakly connected network) is shown. 
However, small gain conditions hold for all the other agents (results not shown in interest of 
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West (m) 


Fig. 1. Trajectory of agents in weakly connected network (inset: net topology). 


180 



Fig. 2. States of agents connected in weakly connected network. 


brevity). 


V. Conclusion 

We presented distributed NMPC framework for formation control of constrained agents robust 
to uncertainty due to data compression and propagation delays. Collision avoidance is ensured by 
means of spatially filtered potential field. Rigorous proofs are provided ensuring practical stability 
regardless of network topology. Simulations illustrate good performance of the proposed scheme 
in both strongly- and weakly-connected networks. Future research directions include the need 
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Fig. 3. Small gain condition for Agent 1 


to cater for model uneertainty, disturbanees and fault toleranee. 
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